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ABSTRACT 


Hoeff ding's  Lemma  gives  an  integral  representation  of  the  covariance  of 
two  random  variables  in  terms  of  difference  between  their  joint  and  marginal 
probability  functions,  i.e., 

r*0O 

{P (X  >  x,  Y  >  y)  -  P(X  >  x)P(Y  >  y) }dxdy. 

OO  —CO 

This  identity  has  been  found  to  be  a  useful  tool  in  studying  the  dependence 
structure  of  various  random  vectors. 

A  generalization  of  this  result  for  more  than  2  random  variables  is  given. 
This  involves  an  integral  representation  of  the  multivariate  joint  cumulant. 
Applications  of  this  result  include  characterizations  of  independence.  Rela¬ 
tionships  with  various  types  of  dependence  are  also  given. 
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1.  Introduction 


It  is  well  known  that  if  a  random  variable  (rv)  X  has  distribution  function 
(df)  F(x)  with  finite  expectation  then 


EX 


fa- 

J0 


F(x))dx  - 


F(x)dx 


(1) 


The  extension  to  high  order  moments  is  straightforward.  That  is,  if  E I X I  <°° 


EXn«n[ 

J0 


r  n-1 


(1-F(x))dx  - 


xn  F(x)dx] 


(2) 


W.  Hoeffding  (1940)  gave  a  bivariate  version  of  identity  (1),  which  is 
mentioned  in  Lehmann  (1966).  Let  Y(x,y),  Fx(x),FY(y)  denote  the  joint  and  mar¬ 
ginal  distributions  of  random  vector  (X,Y),  where  e|xy|,  E|x|,  e|y|  are  assumed 
finite.  Hoeffding’s  Lemma  is 


EXY  -  EXEY 


{Fx  Y(x,y)  -Fx(x)FY(y) }dxdy. 


(3) 


Lehmann  (1966)  used  this  result  to  characterize  independence^  among  other 
things, and  Jogdeo  (1968)  extended  Lehmann's  bivariate  characterization  of  inde¬ 
pendence.  Jogdeo  obtained  an  extension  of  formula  (3)  which  we  now  give.  Let 
(Y^,Y2»Y^)  be  a  triplet  independent  of  (X^.X^.X^)  and  having  the  same  distribu¬ 
tion  as  (-X^.X^.X^)  then 


e(x1-y1)(x2-y2)(x3-y3) 

00 

=  j  K(u1,u2,u3)du1du2du3  (4) 

— 00 

where  K^.u^)-  {P(B1  A^)  +  P(B1)P(A2A3)  -P(A2)P(B1A3)  -  P^WB^) }  - 
(P(AX  A2  A3)  +P(Al)P(A2A3)  -P(A2)P(A1  A3)  -P(A3)P(A:  A2)},  and  At  =  U  1  u  > 
i*  1,2,3*  B^  =  {X^>_-u^}.  Jogdeo  mentioned  that  a  similar  result  holds  for  n^3. 


2 


it 


v>. 


We  give  a  different  generalization  of  Hoeffding's  Lemma.  Notice  that  expression 
(3)  can  be  rewritten  as 

f“ 


Cov(X 


.00  fco 

•T1  -  j 

J  —O0  J  —CD 


Cov(xx(x)  ,xy(y))dxdy 


(5) 


where  xv(x)  = 1  if  X  > x,  0  otherwise  and  that  the  covariance  is  the  second  order 
A 


joint  cumulant  for  the  random  vector  (X,Y).  In  the  following  we  extend  the  results  t 
the  rth  order  joint  cumulant  where  r^3. 


2.  Main  results 


Consider  a  random  vector  (X^,...,Xr)  where  E|x^|r<«>,  i  =  l,...,r. 
Definition!.  The  rth  order  joint  cumulant  of  (X^,...,Xr)  denoted  by  cum(X^,., 
is  defined  by 


.,xr) 


cum(X-,...,X  )  * I(-l)P”1(p-l)t (E  n  X  ) , . . (E  n  X) 
r  Jev.  1  Jev  J 

1  P 


(6) 


where  summation  extends  over  all  partitions  (v^, ...  ,v  ),  p  *  1,  2, . . .  ,r,  of  {l,...,r}. 


It  can  be  shown  (see  Brillinger  1975)  that  cum(X^, . . . .X^)  is  the  c r  ficient 


XT  ^ 

>  t.  ...  t  in  the  Taylor  series  expansion  of  log  E(exp  iS  t  X.). 
1  r  j=l  J  J 


of  the  term  (i) 

Furthermore  the  following  properties  are  easy  to  check: 


(i)  cum(a^  X^  . . .  .a^)  *  ...  af  cumCX.^, . . .  .X^)  ; 


(ii)  cum(X^,...,X  )  is  symmetric  in  its  arguments; 


(iii)  if  any  group  of  the  X*s  are  independent  of  the  remaining  X's  then 


cum(X-,...,X  )  *  0; 
l  r 


(iv)  for  the  random  variable  (Y^ ,X^, . . , .X^) ,  cum(X^+Y^ ,X2> • • • .Xr>=cum(Xj , . . , .X^) 
+  cum(Y1,X2  ,...,Xr); 

(v)  for  y  constant,  r  >_  2,  cum(X^+p,  X2,.,,Xr)  *  cum(X^, . . .  .X^) 


(vi)  for  (X1,...,Xr),  (Y^, • . . ,Y^)  independent 
cum(X1+Y1,,.,,Xr+Yr)  =  cum(X1, . . .  sx^)  + cum(Y^, . . . ,Y^) ; 

(vii)  cumX^EXj,  cum(Xj.Xj)  =  Var  X^  and  cum(X^,x^)  =  covCX^X^.). 

To  represent  certain  moments  by  cumulants,  we  have  the  following  useful  identity. 
Lemma  1.  If  E  |  X^  | ™  <  00 

EX. . . .X  -  EX, ...  EX 
lml  m 

=  E  cum(.X^,k€v^)  . .  ,cum(X^',keVp)  (7) 

where  E  extends  over  all  partitions  (v^, . . .  ,v  ),  p=  1 . m-1,  of  {l,...,m}. 

Proof:  In  the  case  of  m=  2,  p=m-l=*  1  and  (7)  reduces  to  the  well  known 

EX^-  EX1EX2=  cumCX^ke  =  covCX^X^ 

Notice  that 


EX. . . .X  -  EX  . . .EX 
1  n  1  m 


EX....X  -X  .X  -EX....EXm  ,EX  .X 
1  m-2  m-1  m  1  m-2  m-1  m 


+  EX.  ...  EX  „cov(X  .  ,X  ). 
1  m-2  m-1  m 


(8) 


Introduce  the  new  notation  Y^  =  X^,  i=  l,...,m-2,  Y^_^ =  ^m-l^m"  Theorem  2.3.2 

in  Brillinger  (1975,  p.  21)  and  induction  we  get  (7). 

Our  main  result  is  the  following. 

Theorem  1.  For  the  random  vector  (X^, ..  ,Xr>  r>l,  if  E  i I  <“  i=1*2,...r>  then 


cum(X^, 
where  xx  (x^ 


•v  = 


cum(xx  (x1) , 


,XX  (xj.))dx1...dxr 


1,  if  Xi>  xif  0  otherwise. 


(9) 


To  prove  the  theorem  we  need  a  lemma  which  is  of  some  independent  interest. 


Lemma  2.  If  E | ... |  <  ®,  we  have 


r  r  f  ?  UJ 

EX  ...X  -  (-l)r  L.J  (F(x)  -  l  t (x  )F(x  ) 

J  J  j-l  3 

+  £  e(x  )e(x  )F(x^i,3\ . . .+  (-l)r  n  e(x  j}dx  , . . .  ,dx 
i<j  3  j-l  3  1  r 


(i,»  •  •  • » ij.) 

where  e (x . )  *  1  if  x. >  0,  0  otherwise.  Here  x  represents  (x.,...,x 

1  i_  “  . . ±k)  1  1 

X±  i ...  j  X±  t  x±  ^ ...  x .  ,  x .  •  •  <j^)  *  Also  F ( x  )  is  the  marginal 

^  (i  i^)  — 

df  of  JT  lr"  k  ,  We  omit  the  subscripts  for  F  for  simplicity  when  there  is  no 
biguity,  e.g.  F(x^)  is  the  marginal  of  (X2 . . 

Proof :  First,  we  have  the  identity 

Xi5f  <u> 

'  «oo  ^ 

where  I.  ,(X  )  ■  1  if  X  <  x  ,  0  otherwise.  Then,  by  Fub ini's  theorem 
i  i  i 

exi---x'  ■  E(ii  Lie<xi)'i(-.*1)ai,idxii 


where 


EX. . . . 


’  E{J;;’J  *al  Ie(xi)-I(-,xi](xi)]dx1...dxr} 
*  JE{i!I1te(Xi)  ”  W/V*  dx1---dxr 


OD  .  r 


...  {  n  e(x  )  -  l  n  e(x,  )F(x  )  +  [  II  e(x.  )F(x  ,x  ) 

-»  J  i-l  j-l  kj*j  3  i<j  k+i,i  3 


..  +  (-1) rF(x) }dx^. . .dxr 


which  is  just  the  right  side  of  (10). 


Remark  1.  It  is  easy  to  see  that  (1)  can  be  written  as  EX  -  (e(x)-  F(x))dx, 


which  is  a  special  case  of  (10) .  Thus  lemma  2  is  an  extension  of  (1) . 


5 


*  .1 


a 


9 


n  n  -1 

Remark  2.  Using  the  identity  X  5  n  x.1  [e(x  )-  I.  ,(X. )]dx. 

1  oo  1  1  1  1  1 

we  can  also  obtain  an  extension  of  (2)  i.e. 


ni  \  k  r 00  nr1  v1 

EX^..^  =  (-1)  n^.I^  ...  x  . 

J  _<x» 

*  (F(x  ...x  )  -  l  e(x  )F(x^)  +  \  e(x.)e(x  )F(x^’^)  . . 
j-1  j  i<j  1  j 


+  (-1)  II  e(x.)  }dx1  . .  .dx, 
i=l  i  i  k 


* 


where  n^>_l,  n^+. .  ,+n^_<  r . 

Remark  3.  When  the  X^'s  are  nonnegative  (12)  reduces  to 

nl  nk  [  °°  f  n.-l  0,-1 

EX^  •••xk  =  .  ..  nl*',nkxl  •••*k<  F(x^, . . . ,x,  )dx^, . .dx^ 


where  FCx^-.-Xj^)  is  the  survival  function  P(X^>x^t  i=l,,..,k),  The  bivariate  case 
of  (13)  was  mentioned  by  Barlow  and  Proschan  (1981,  p.  135). 

The  proof  of  the  theorem  1  involves  routine  algebra  and  the  use  of  Fubini's 
theorem  and  lemma  2.  We  have 


r 

i 


Cum(X  , ...,X  )  =  E(-l)P_1(p-l) !(E  n  X  )...(E  H  X  ) 
r  Jev.3  jev  3 

J  1  J  p 

=  E(X1,..X  )  -  E  E(  n  X.)E(  n  X.)  +  . .  .+(-l)r-1(r-l) !  II  EX. 

1  jev1  3  jev2  3  j=l  3 

r  00  r  r 

=  (~l)r  ...  (F(x)  -  £  e(x  )F(x  ^)  +  £  e(x.)e(x  )F(x^i’^) 

J-co  J  -  jtl  J  “  i<j  1  J  ~ 

r 

+  ...+  (-l)r  n  e(x.) }dx. . . .dx 

J-1  3  r 

n  +n 

vi  v2  00  r 

-  (-1)  ...  {F(x  ,  je  v^-  l  e(xk)F(x  ,  j  e  v^\k) 

-0D  3  ke^  3 


0 


V. 

+  ...(-1)  n  e(x.)  }{F(x. ,  iev)-  l  e(x  )F(x  ,  i  e  v  k) 
J£v.  J  1  2  kev. 


+  ...(-1)  II  e(x  )}dx1  ...  dx 
j€V2 
r°  f  r 

+  (-1) r(r-l)  !  ...  II  [e(x  )  -  F.  (x  )  ]dx1  . .  .dx 

J-J  i=i  1  1 


where  n  is  the  number  of  indices  in  v.,  F(x.,  je  v.)  is  the  marginal  of  rv's 
v.  i  1  1  ' 

in  vi>  and  Fi(x)  is  the  marginal  of  Xi>  All  terms  with  e(xj  factors  cancel  and 


the  quantities 


1  n  j  =2,..., 


u  \j 

i=l  i 


p  are  all  equal  to  r. 


Thus , 


f  “ 

cura(X  ...X  )  =  (-l)r  ...  (F(x)-ZF(x  ,  j  e  v1)F(xi>  i  e  v2> 

^  j  —00  ^ 


+...+  (-1) r(r-l) !  n  F  (x  )}dx  ...dx 
i-1 


-  (-l)r  ...  {Z(-1)P  (p-l)!F(xjt  je  v1)...F(xj,  je  vp)  }dxx .  .  .dx^ 


=  (-l)r  ...  cum(l  -  xx  (x1),...,l  -  Xx  (xr))dXl...dxr 

-oo  1  r 


cum(x„  (x1),...,xx  (xr))dx1. . .dxr< 


The  last  equality  follows  upon  using  properties  (i),  (iii)  and  (iv)  of  the  cumulant. 
This  completes  the  proof. 

Remark  4.  The  result  of  Theorem  1  gives  that 

*00  fOO 

cum(X  ,...,X  )  =  ...  cum(xx  (x.) . Xx  (x.)  )dx1 . .  .dxf . 

*■  —00  —00  1 

The  integral  can  then  be  expressed  in  a  variety  of  ways.  A  general  form  is 


7 


1 


(_l)card  B  cum(xx  (xi)  ,  ie  A;  1  -  xx  (x±)  ,  ie  B) 
i  i 


where  Au  B  =  {l,2,...,r}.  We  then  have  various  combinations  of  the  distribution  and/ 
or  survival  function  in  the  integrand.  Some  examples: 
i)  for  A  =  <f> ,  card  B  =  r  the  integrand  is 


r 

(-1) r{ F(x)  -  I  F(x  ,jev  )F(x  ,  ie  v2)  +  ...+(-l)r(r-l)  !  n  F  (x  )}; 

J  1  ^  i=l  1 


ii)  for  B  ■  0  the  integrand  is 


F(x)  -  Z  F(x  ,  jev..)F(x  ,iev~)  +  ...(-l)  (r-1)  !  II  F.(x.). 

J  i=l  1  1 


3.  Applications 

In  some  sense,  the  cumulant  is  a  measure  of  the  independence  of  certain  class 
of  rv’s. 

The  following  result  was  shown  by  Jogdeo  (1968).  Let  F  v  (x  ,x„,x  ) 

i9z9o  -L  ^  j 

belong  to  the  family  M(3)  where  M(3)  denotes  the  class  of  trivariate  distributions 
such  that  there  exists  a  choice  of  A  and  h  ,  i= 1,2,3  such  that 

3 

PCXjAjX^  X2A2x2,  X^A^x^)  A  n  p(XiAixi)  (14) 

i=l 

for  all  x^,x2,x^  where  the  A,  A^  each  denote  one  of  the  inequalities  >_  or  <_, 

Then  X^,X^  for  all  i  ^  j  are  uncorrelated  and  EX^X^^  =  EX^EX2EX^  if  and  only  if 
the  X^'s  are  mutually  independent. 

Using  Theorem  1  we  get  this  conclusion  directly.  The  "if"  part  is  trivial. 

Conversely  since  Fe  M(3)  we  know  F  (x.,x,)e  M(2)  (M(n)  can  be  defined  similarlv)  . 

XiXj  i  j 

Since  X^  and  X^  are  uncorrelated  this  implies  the  X^'s  are  pairwise  independent 


by  Hoeffding  s  Lemma.  Thus  using  Remark  4,  (9)  becomes 

ex1x2x3  -  ex1ex2ex3  = 


+  {P(X1A1x1,X2A2x2,X3A3x3>  -  P(X1A1x1)P(X2A2x2)P(X3A3x3> }dx1dx2dx3 . 


Now  since  Fe  M(3)  the  integrand  will  not  change  sign,  so  that  EX^X^X3=  EX^EX2EX3 


implies 


P(X1A1x1,X2A2x2,X3A3x3) =  P(X1A1x1)P(X2A2x2)P(X3A3x3)  for  all 


x1»x2>x3  which  means  that  the  X^'s  are  independent, 


The  n-dimension  extension  is  straightforward  and  is  given  below. 


Theorem  2  If  F„  v  (x,  ,...,X  )  e  M(n) ,  then  EX.,...X  =  II  EX.  for  all  sub- 

-  Xl,...,Xn  in  1  *k  i-1 


sets  { i  , . . . ,  i^}  of  {l,...,n}  if  and  only  if  X3,...,Xn  are  independent. 

Proof:  F„  „  (x,  ,...,x  )e  M(n)  means  F„  „  (x.  ,...,x.  ) £  M(k)  for 

Xl***’*  n  n  i  X1  \ 

1  k 

any  subset  (ix . ik) .  By  induction  on  n,  using  Theorem  1,  we  obtain 

00  I 

n  r  n 

EX.  .  .  .X  -  II  EX.  =  +  ...  (P(X.A  x  ,  i=  1, .  . .  ,n)  -  H  P(X.A.  x.)  }dx.  . .  .dx  . 

1  n  .=1  j  ~  J  i  i  i  i=1  i  i  i  1  " 

n 

The  integrand  will  not  change  sign  ,  so  EX  .  ..X  =  n  EX  implies  that  the  X  are 

j=l  J  i 

mutually  independent. 

Several  authors  have  discussed  dependence  structures  in  which  uncorrelated ness j 

j 

implies  independence.  Among  them  are  Lehmann  (1966),  J©gdeo  (196S)  ,  Joag-dev  (19  83)^ 

Chhetry,  D.  et  al  (1985).  j 

We  now  give  a  definition  from  Joag-dev  (1983).  Let  X=  (X. , . . . ,X  )  be  a 

i  n  j 

random  vector,  A  be  a  subset  of  {l,...,n}  and  x  =  (x3>...,xn)  a  vector  of  constants. j 

Definition  2.  Random  vectors  are  said  to  be  PUOD  (positive  upper  orthant  dependence)  ! 

- -  | 

if  a)  below  holds,  PLOD  (positive  lower  orthant  dependence)  if  b)  below  holds  and  ! 
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POD  (positive  orthant  dependent)  if  a)  and  b)  below  hold,  where 

n 

a)  P(X>  x)  >_  n  P(X.  >  x.)> 

i=l  1  1 

n 

b)  P(X<  x)>  n  P(X  <  x.). 

i=l  1  1 


If  the  reverse  inequalities  between  the  probabilities  in  a)  and  b)  hold  the 
three  concepts  are  called  NUOD,  NLOD  and  NOD  respectively. 

Definition  3,  A  vector  X  is  said  to  be  SPOD  (strongly  positively  orthant  dependent) 
if  for  every  set  of  indices  A  and  for  all  x  the  following  three  conditions  hold: 

c)  P(X>  x)^P(X.  >  x.  ,  ieA)P(X^>xJ,  j  e  AC) 

d)  P(X<x)>P(X1<x.,  i£A)P(X,<x.,  j  e  AC) 

e)  P(X. >  x.  ,  i  e  A,  X  <^x.,  j  e  AC)  P(X.  >  x.  ,  it  A)P(X,  <  x.,  j  e  AC)  . 

^  J  J  3.1  J  J 

The  relationships  among  these  definitions  are  as  follows: 

.  PLOD  Cs 

XA 

Association  SPOD  POD  M(n) .  (15) 

Xj  PUOD 


Since  association, SPOD,  POD,  PLOD,  PUOD  are  all  subclasses  of  M(n)  ,  Theorem  2 
generalizes  some  results  in  Lehmann  (1966)  and  it  gives  us  another  proof  of 
Theorem  2  in  Joag-Dev  (1983)  as  well  as  some  new  characterizations  of  independence 
for  POD  random  variables.  Corollary  1  is  the  result  of  Joag-Dev. 

Corollary  1.  Let  X^,...,Xn  be  SPOD  and  assume  cov(X^,X_.)=  o  for  all  i  ^  j.  Then 
X^,...,X  are  mutually  independent. 

Proof :  Since  X^,...,Xn  SPOD  implies  (X^. . .X  ) e  M(n)  by  Theorem  2  we  need  only 

k 

check  EX.  .  .  .X.  =  II  EX.  for  all  subsets  {i.  , . . .  ,ij  of  (1, . . .  ,n  }.  When  n=  2 

1  k  j-1  xj  i  k 


J- 

In  Definition  2  in  Block  et  al  (1981),  POD  is  used  for  ^hat  is  called  PUCD  in 
this  paper. 


SPOD  is  equivalent  to  PQD  and  uncorrelatedness  implies  independent.  By  indue 

tion  on  n  we  may  assume  all  subsets  with  (n-1)  rv's  are  mutually  independent  and 
k 

thus  EX.  ...X  =  n  EX  for  all  1_<  k^n-l.  Hence  cumCX^  ke  v  )  =  0  whenever 

^1  ^k  1=1  j  n 

card(v  )<  n-1.  So  we  only  need  to  check  EX....X  -HEX.  By  Lemma  1,  Theorem 
p  ~  j=l  J 

1  and  because  of  the  independence  of  any  (n-1)  rv's 


EX, ...  X 


-  n  ex 

J-i  J 


=  E  cum(Xk,  ke  . .  .cumCX^  ke  vp) 


—  cum  (X^ i . *  * i Xn ) 

n 

(P(X>  x)  -  n  P(X  >  x,)}dx-...dx  >  0. 
1=1  3  2 


f  • 

—  1 


(16) 


Similarly 


EX 


1" 


.X 

n 


n 

-  n  ex 

j-i  J 


=  E(-X1)(-X2)X3...Xn 


E(-X1)E(-X2)EX3...EXn 


cum(-X^ ,-X2 ,X^ . . .Xn) 


...j{P(-X1>  xr  -  X2>  X2,  X3>  x3...Xn>  xn)  - 


P(-Xx>  xL)P(-X2>  x2)P(X3>  x3)...P(Xn>  xn)  }dxr 

{P(X1<-x1,  X2<"x2’  Xi>  Xi’  i=3*--”n) 

n 

-  P(X.  <  -x.)P(X  <  -x  )  n  P(X  >  x  )}dx  ...dxn 
l  i  *  *  i=3 

{P(Xj  <  -Xj ,  j -  1,2,  Xi >  x^  i*  3, . . . ,n) 


.dx 


•  •  « 

—CO' 


*  • 

J  —  00  J 


-  P(X,  <  -X  ,  j  =  1 , 2)P(Xt >  x  ,  i=  3. .  .n)  Mx^  .  .dxn 
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The  last  equality  holds  by  the  induction  assumption  of  mutual  independence  and 
the  last  inequality  is  due  to  SPOD.  Combining  (16)  and  (17)  completes  the  proof. 
Theorem  3.  Let  be  POD  and  assume  X^.X^  for  all  i  ^  j  are  uncorrelated. 

Then  X^.X^.X^  are  mutually  independent. 

Proof :  The  following  two  summands  are  nonnegative  since  X3,X2>X3  are  POD.  By 
Lemma  1  we  then  have 


[p(xx>  xr  x2>  x2,  x3>  x3)  -  n  P(Xi£x1)] 

3 

+  [P(X1£  x3>  X2_<  x2,  X3£X3)  -  n  P(Xi£xi)] 


=  cum 


(XY  (x.),  XY  (x  )  ,XY  (x,))  +  l  P(X  >  x  )cov(Xy  (x.\xY  (x.)) 
X1  1  X,  2  X3  3  .^j#k  i  i  X.  j  Xk  Tc 


+  cum(l  -  xY  (x,),  1  -  XY  (x,),  1  -  XY  (xj)+  l  P(X  <  x  )cov(xY  (x  \x  (x,)) 
X1  1  X2  2  X3  3  ix  Xj  J  Xk  k 

=  l  cov(x  (x  ),  xY  (x.)). 
i^j  xi  1  J 

Since  X  ,X.  POD  and  cov(X  ,X  )  =  0  we  obtain  cov(x  (x.)xY  (x.))  =  0.  Thus 
i  j  3  1  J  xi  1  Xj  J 

P(Xi>  xi,  i-  1,2,3)  -  n  P(Xi>  xt)  =  0,  i.e.  Xj^.X-j  are  mutually  independent. 

Remark  5.  For  three  rv's  X^,X2,X3  the  mixed  positive  dependence  defined  in 

Chhetry,  et.  al  (1985)  implies  POD  but  the  converse  is  not  true  as  shown  by  an 

example  in  Joag-dev  (1983) .  Notice  that  since  the  mixed  positive  dependence  implies 

POD  in  Corollary  l,the  SPOD  can  be  relaxed  to  this  mixed  condition. 

Theorem  4.  Assume  n  =  2H+1  is  an  odd  positive  integer  and  X^ . . . X^  are  POD.  Then 

if  E(X  , .  . . , X  )  *  EX  ..EX.  where  2<^k<  2t  for  any  subset  (i.,  —  ,i.)  of 
il  \  il  k 

{ 1, .  . . , 2JI+1}  it  follows  that  X^,  —  ,xn  are  mutually  independent. 


T^T^TJTT^TTTH  WWM  WXJWV'W  M  gm  ■  1  WT WTT  W*1  W  W  ■  i  IT"  J  .VT’wrnr  rwmr"1Tl-TF  'W  '  -S'  • 
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Proof ;  By  Theorem  2,  we  need  only  check  EX^...Xn 

EX  . • .X  -EX.... EX  =  cum(X  . . .X  ) 

In  1  n  In 


EXX. 


. . EX  .  On  the  one  hand 
n 


oo 


{P(Xi>  Xi,  i =  1, 


n 

,n)  -  IT  P(X  >  x.)  }dx,  . .  .dx  >  0  . 

j-i  J  J  1 


On  the  other  hand 


EX, ...  X  -  EX, ...  EX 
1  n  1  n 


-  (-1)2£+1  {E(-X.)...(-X  )  -  E(-X.)...E(-X  )> 
Inin 


=  (-l)2il+^  cum(-X.  , . . .  ,-X  ) 
i  n 


(-1) 


2JI+1 


•  00  f  n 

...  {P(X  <  -x,  ,  i=  1, . . .  ,n)  -  II  P(X.  <  -x.)  }dx.  . .  .dx  <^0. 

_o,  J  1  1  jss]_  J  J  1  n 


Remark  6.  For  n*  4  we  construct,  in  Example  1  below,  POD  rv's  such  that  any  three 
of  X^'s  are  independent  but  the  X^s  are  not  mutually  independent.  This  shows 
that  the  conditions  of  Theorem  4  are  reasonable.  In  Example  2,  we  show  that  for 
POD  rv's  cov(X^,Xj)  *  0  is  not  enough  to  give  mutual  independence  when  2£+l  > 3. 
Example  1.  Let  X^,...,X^  have  the  distribution  given  below.  It's  easy  to  check 
that  for  if4  j ^  k,  X^ ,X^ ,X^  are  mutually  independent  and  that  X^...X^  are  POD. 


1  11 

Since  P(X^>  i=l,...,4)-  n  P(X^ >  — )  =  — >  0,X^...X^  are  not  mutually  independent. 

i=l 

Notice  also  that 


p(xl±xl>  X2-x2’  X3>X3’  X4>x4^ 

-  P(X1£x]?^2£x2)P(X3>  x3»X4>  x4> 

=  cum(l  -  xx  (Xj^)  ,  1  -  xx  (x2)  ,  xx  (xx)  , 

=  cum(x  (x  ) ,  i=  1, . . . ,4) 

A .  1 


=  P(X. >  x 

l 


i-  l,...,A)  -  n  p(x  >x  ) 
i=l 


(x2>) 


>  0, 


so  these  rv's  are  not  SPOD. 

Example  2.  Let  X  .....X^  have  the  distribution  given  below. 


X1 

X2 

X3 

X4 

X5 

Pr 

1 

1 

1 

1 

1 

1/16 

1 

1 

0 

0 

1 

1/16 

1 

0 

1 

0 

1 

1/16 

0 

1 

1 

0 

1 

1/16 

1 

0 

0 

1 

1 

1/16 

0 

1 

0 

1 

1 

1/16 

0 

0 

1 

1 

1 

1/16 

0 

0 

0 

0 

1 

1/16 

1 

1 

1 

1 

0 

1/16 

1 

1 

0 

0 

0 

1/16 

1 

0 

1 

0 

0 

1/16 

0 

1 

1 

0 

0 

1/16 

1 

0 

0 

1 

0 

1/16 

0 

1 

0 

1 

0 

1/16 

0 

0 

1 

1 

0 

1/16 

0 

0 

0 

0 

0 

1/16 

It  is  easy  to  check  that  this  is  PUOD  and  PLOD,  thus  it  is  POD. 
EXj,  -  j  for  all  i.j. 

In  this  example  we  can  use  Theorem  3  to  prove  that  any  X^ 
independent  since  subsets  of  POD  rv's  are  still  POD. 


However  EX ^  =  4/16 
,Xj,X^  are  mutually 


Newmann  and  Wright  (1981),  using  an  inequality  for  the  ch.f.'s  of  rv's 


X^,...,X  ,  provided  another  proof  for  the  characterization  of  the  independence 
1  m 

of  associated  rv's.  This  is  Theorem  1  of  Newmann  et  al  (1981).  These  authors 

proved  that  if  X.,...,X  are  associated  with  finite  variance,  joint  and  marginal 
l  m 

ch.f.'s  <f>(r1,...,r  )  and  <f> .  (r . )  then 
1  ®  j  3 


♦(rl»  *•••'«>  '  "Willi  Jrj  I  |rk|cov(XJ»xlc), 

j=l  jrk 


(18) 


To  extend  this  inequality  we  need  the  following  lemma. 


im 


Lemma  3.  For  the  rv  (X^,...,Xm)  with  E|X^|  <°°, 


cum(exp(ir  X. ) , . . . ,exp(ir  X  )) 
li  mm 


r  00 


m 

i“r.,...r  exp(i  l  r  x  )cum  (xx  (x.^ . Xx  (x^Jdx^.. 

m  j=>l  J  J  A1  m 


dx  (19) 
m 


where  r, ,...,r  are  real  numbers  and  xv  (x. )  *  1  when  X  >  x  and  0  otherwise. 
1  m  Xj  J  J  J 

Proof :  This  proof  of  result  is  similar  to  Lemma  2.  Use  the  identity 


«p(irkxk)  "1Ei  rkexp(irA)(e(\)  “^-.x.  ](V)dv 

J  -«  k 

We  obtain 


cum(exp(ir^X^) ,  k  =  l,...,m) 

=  cum(exp(irkX^)  -  1,  k*l,...,m) 


E(-l)P(p-l)!  n  fE  n  (exp(irkXk)  -1)] 

i-1  kev. 

»  SL 

m  P 


•  «  « 
—oo  J 


t  •  • 

J  — O0  J 


imr  ,  ...,r  exp(i  £  r  x  )  {I(-l)p(p-l)  !  n  [E(  n  x*  MJdx^. 
®  j-1  J  J  d=l  ^€V£  K 

m 

i\r  . ,  rn  . x^(xB))dx. , ,  .  ,dxm. 


.dx 


m 


Using  Lemma  3  we  can  obtain  a  result  parallel  to  (18)  for  certain  classes  of 


ns. 


Theorem  4.  If  X^,...,Xm  are  rv's  such  that  E|x^|m<°°,  j**l,...,m  and  cum(x^  (x^) 
. ..,  xx  (x^))  has  c^e  same  sign  for  all  subsets  (i^ i^)  of  (I,..., mi  and  1 


all  Xl,...,xk.  Then 


|  4>  ( r  , . . .  ,r  )  -  n  <*. .  <r .)  |  <  n  |r.  |  •  |EX.  . .  .X  -EX.... EX  |.  (20) 

1  m  j=1  J  j  ~  j=l  J  1  m  1  m 

Here  <Kr1,...,r  )  and  4>j(r.)  are  the  joint  and  marginal  ch.f's  of  (X1#...,X  ). 
l  m  j  j  i  m 

Proof :  From  the  fact  that  the  cum(x«  (x^ » • . • »XX  (x^))  have  the  same  si8n»  and  from 

*1  m 

Lemma  1,  Lemma  3  and  Theorem  1  we  have 

m  mm 

1 4  ( r1 , . . . ,  rm)  "  n  <t>j  (rj)  I  -  |e  n  expdr^X^)  -  HE  expdr^)  | 
j—1  k*l  kKl 

=  1 1  cum(exp  ir  j  Xj  ,  j e  v^) . . ,cum(exp  ir j  X^ ,  j  €  v^)  1 


...  ir-...r  exp(i  J  r ,x  / { Ecum(xv  (x  ) ,  jev  ) . . .cum(xv  (x.),  jev  ) 

-J  1  ”  jii  J  J  Xj  J  1  Xj  J  P 


dx,  .  .  .dx 
1  m1 


*  00 

-  Ir1l,-*lrml  !Z  CU“(XX  (O*  jevx) 

.00  j 

in  r  • 

-  n  |rk|  |  ...  I  cum(xx  (x  ) , j e  v1)...cu 

k=l  -co  j  J 


.  ..cum(xv  (x  ) ,  jev  )|dx1...dx 
Xj  j  pin 


.  ..cum(xx  (Xj) ,jevp)dx1. . .dx^l 


=  I  r^  J  . . .  |rj  1 1  cum(Xj  ,  jeVj^)  . .  .cum(Xj  ,  jevp) 


r.  . . .  r  EX. . . .X  -  EX. . . .EX 
'I1  1  mM  1  m  1  m1 


Remark  7 .  jn  Example  3  below  we  define  rv's  which  are  uncorrelated  but  not  mutually 
independent.  By  Corollary  1  they  cannot  be  associated  so  that  Theorem  1  of  Newman 
and  Wright  (1981)  does  not  apply.  However  Theorem  4  gives  an  upper 


V  i  w 
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bound  for  the  difference  of  ch.f's,  since  it  is  easy  to  check  cum(xY  (x. ),x  (x.]>  =0 » 

Xi  i  Xj  J 

i#  j,and  cum(xx  (x.^  ,  xx  (x2),xx  (x3^l°  f°r  all  x^x^x^ 


Example  3.  Consider  the  rv’s  with  distribution  given  below. 


X1 

X2 

X3 

Pr 

1 

1 

1 

1/4 

1 

0 

0 

1/4 

0 

1 

0 

1/4 

0 

0 

1 

1/4 

These  are  PUOD  but  not  POD. 

For  nonnegative  rv's  we  can  go  further. 

Theorem  5.  If  the  rv’s  X^,...,Xm  are  nonnegative  (nonpositive)  and  PUOD  (PLOD) 
with  finite  mth  moments  then 

m 

l«frCri . rm}  -  ^1*j<rj)l  |EX1...Xm-  EX1...EXn|.  (22) 

Proof :  We  prove  the  PUOD  case  only.  Using  Lemma  1,  Lemma  3  and  Remark  3 


m  mm 

1 (r  , . . .  ,r  )  -  n  <)>  (r  )  |  =  |E  exp(i  £  r  X  )  -  n  E  exp(ir.X 
j-=l  J  3  j=l  3  3  j-1  *  3 


)| 


°°  f  ® 

•  •  •  I  ^  . . .  j  r^exp  (i  £  r^x  )  [F(x^ , . . . ,  x^)  ~  E^(x^),...,  ( Xxn^  ^  ^xi  *  *  * 

j  J 


dx 


m 


1  I  rjl  *  *  - !  rm  I 


lril---lrml 


J  o  J 


|F(x, , —  ,x  )-F,  (x,)...F  (x  )|dx, ...dx 
l  mix  mm  i  m 


0  J 


[F(x,,...,x  )  -  F,(x,)...F  (x  )]dx,...dx  I 
l  n  11  mnl  m 


r,  .  . .  r  EX.  . .  .X  -  EX,  . . .  EX  . 
1  1 1  '  m1 '  1  m  1  m1 


(23) 


Corollary  2.  Under  the  conditions  of  Theorem  5,  if  EX, ...X  =  EX, ...EX  ,  then 
- * —  1  n  1  m 


X^,...,X  are  independent. 
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4.  Cumulants  and  Dependence 

Cumulants  provide  us  with  useful  measures  of  the  joint  statistical  dependence 
of  random  variables.  However,  the  relationships  with  positive  and  negative  dependence 
are  not  similar  to  those  in  the  bivariate  (covariance)  case.  We  give  some  examples 
to  illustrate  the  relationship  between  the  sign  of  the  cumulant  and  dependence  in 
the  trivariate  case. 

Remark  8.  By  property  (iii)  of  cumulants  if  any  group  of  X's  is  independent  of  the 
remaining  X's  then  cum(X^, . . . ,X^)  =  0.  The  converse  is  true  for  normal  distributions 
when  r  -2  but  not  for  r>  2.  For  the  trivariate  normal,  we  can  have  cum(X^,X2,X3) =  0 
where  X^.X^.X^  are  not  necessarily  independent. 

Remark  9.  Assume  EX^  0  for  i=  1,2,3  and  cov(X^,X^)^0  for  i,j  =  1,2,3  (or  the  even 

stronger  conditions  cov(xx  (xi^,Xx  (x  ))>_0  and  cum(X1> X2 ,X3>  >_  0 .  These  do  not 

i  J  2 

imply  PUOD  as  is  shown  in  the  following  example. 

Example  4.  Let  X^.X^.X^  take  the  values  0,  +1  with  :  P(X^  =  x^,  X2  =  X^=  x^, 

X1X2X3  *  0)  =  °:  P(X1=  X2=  X3=  0)  =  0;  P(Xi=  °»  Xj=  Xj’  \=  V  XjXk>  0)  =  k* 
i,j,k  =  1,2,3,  x  -  xk  -  1  or  Xj  -  =  -1 ;  and  P(XL=  x^  X2=  x2>  X3=  x3>  =  for 

the  remaining  cases.  It  is  easy  to  check  that  EX^ *  EX^X2X3  ■  0,  EX^X^ >  0,  and 

cum(X^,X2,X3>  =  0  but 

p(xx>  o,  x2>  o,  x3>  o)  -  p(xx>  o)p(x2>  o)p(x3>  o)  -  -  (-||)3<  o. 

Remark  10.  Let  EX^O  and  assume  (X^.X^X^  PUOD.  This  does  not  imply 
cum(X^,X2,X3)  >  0  as  is  shown  in  Example  5, 

Example  5.  Let  (X^,X2,X3)  have  distribution  given  below.  It  is  easy  to  check 
that  (X1,X2,X3)  is  PUOD  and  that  EXt  =  0,  but  cum^.X^X^  *  -0.15  <  0. 
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X1 

X2 

X3 

Pr 

1 

1 

1 

0.35 

1 

1 

-1 

0.05 

1 

-1 

1 

0.05 

-1 

1 

1 

0.05 

0 

0 

-1 

0.05 

-1 

0 

0 

0.05 

0 

-1 

0 

0.05 

-1 

-1 

-1 

0.35 

Remark  11.  Let  (X^.X^.X^)  be  associated.  It  need  not  be  true  that  cum(X^ ,X^ ,X^)  0 

as  is  shown  in  Example  6. 

Example  6.  Assume  (X3,X2,X3)  are  binary  rv's  with  distribution 

P(XL  =  X2  =  X3  -  0)  =  0.3;  P(XX  -  x1§  X2  -  x2,  X3  =  X;})  =  0.1  for  all  other 
3 

{x1,x2>x3} e  {0,1} 

Checking  all  binary  nondecreasing  functions  T  (X^,X2»X3)  and  &(X3,X2,X3)  we  have 
cov(i;A)_>  0.  Thus  (X3,X2,X3)  are  associated  but  cum(X3 ,X2 ,X3>  *  -0.012<0. 

Remark  12.  If  (X,Y)  are  binary  and  cov(X,Y)-^0  then  (X,Y)  is  associated  as  was 
shown  in  Barlow  and  Proschan  (1981).  However  if  (X^,X2,X3)are  binary,  then 
cov(X^,X^) ^ 0,  i,j=*  1,2,3  and  cum(X^ ,X2 ,X3)^  0  do  not  imply  (X^,X2,X3)  associated 
as  is  seen  in  Example  7. 

Example  7.  Assume  (X^,X2,X3>  are  binary  rv's  with  the  distribution  below.  Then 

cov(X  X  )  *  —  >  0  and  cum(X.  ,X0,X_)  -  ~r  >  0.  However  for  the  increasing  functions 
,j '  igQ  w  123  13o 

max(X^,X2)  and  max  (X^,X3) 

cov(max(X1,X2)  maxCX^.X^)  =  -  -g^<  0> 
so  (X^,X2,X3)  are  not  associated. 
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If  we  add  some  restrictions,  some  results  can  be  obtained.  We  give  these 
below  and  omit  the  easy  proofs. 

Proposition  1.  If  cov(X^,X^)  *  0,  for  i,j  =  1,2,3  then  (X^.X^.X^)  PUOD  implies 
cum(X1,X2,X3)  ^0  and  (X^X^Xj)  PLOD  implies  cumU^X^X^  _<  0 . 

Remark  13.  Notice  that  under  the  above  assumptions  we  have  the  pecul iar  situation 
that  PUOD  <=>  NLOD  and  PLOD  <*>  NUOD. 

Proposition  2.  Let  (X^.X^.X^)  be  a  binary  trivariate  rv.  If  covCX^ ,X^ ) >_ 0, 
cum(X^ ,X2 .X^)  >  0,  and  additionally  condition  (M)  below  holds,  then  (X^,X2»X3)  is 
associated  for  i,j,k  =  1,2,3. 

1  (M) 

cov^JlXj,  X^X^)  >  0  J 

where 

X^Xj  =  1  -  (l-Xi)(l-XJ)  =  max(Xi,Xj)  . 

To  prove  Proposition  2  we  need  to  check  for  all  binary  increasing  functions  Y 
and  A  that  cov(r  (Xj.  ,X2 .X^ACXj^ ,X3)  )  >_  0 .  We  leave  this  to  the  reader. 

Although  cum(X^,X2,X3) >_0  does  not  imply  PUOD  we  introduce  a  new  condition 
which  does  imply  positive  dependence. 


Definition  4. The  r.v.  (X^,X2»X3)  is  said  to  be  positive  upper  indicator  cumulant 


dependence  (PUCD)  if  for  all  x^,X2»x3 


F(x1,x2,x.)  -  F1(x1)F2(x2)F.(x3)  >_  l  F.(x  )cov(x  <x  )x,  (x^^O. 

J  k 

It  is  easy  to  see  that  PUCD  is  equivalent  to 

cov(xx^(xi),Xx(xj))lO  for  all  i,j  and  cumCx^Cx^ ,  xx  (x2> ,  xx  (x3>)^0. 
The  relationships  between  PUCD  and  other  positive  dependence  concepts  are  as 


follows : 


PUCD  =>  cum (X. ,X_,X_) >  0 

jj,  1  2  3  “ 

POD  =>  PUOD  =>  cov(X±X3  )  >_  0 


and  no  other  implications  hold.  Example  5  shows  that  PUOD  />  PUCD,  Example  6 
shows  that  POD  PUCD,  Example  3  shows  that  PUCD  POD  and  Example  8  below  shows 
that  cum(X^,X2,X3)  0  PUCD. 

Example  8.  Let  (X^,X2,X3>  be  the  r.v.  with  survival  function 

F(x1,x2,x3)  =  e-^x(x1,x2,x3)>  x>0> 

2  1 
Then  cum(X^,X2,X3)  =  — -j  >_  0  but  X^,X2»X3  are  not  PUCD.  Let  x^=X2=x3  =  —  1°  ^/3, 


F(x1,x2,x3)  -  F1(x1)F2(x2)F3(x3)  =  , 


l  Fi(xi)cov(x^(xj),xXk(xk))  =  ff 

m 

By  Theorem  4  if  (X.  ,...,X  )  is  PUCD,  then  EX....X  =11  EX,  implies  mutually 

In  i  m  j 

independence.  The  definition  of  PUCD  can  be  generalized  to  lower  positive  and 
negative  dependence  concepts  also. 
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